Select Documents Plugin

Use the Select Documents plugin to select a list of Campaign Manager documents and output that list.

This section addresses how to use the automated Select Documents plugin in an open-source ETL package called Kettle.

Background

Campaign Manager stores the interactions that the user has with the data in the form of documents. Some documents contain entries that define derived fields or reports. Schedule the execution of these documents on a regular basis, for example daily. The Kettle Execute Documents plugin requires a list of Document Ids to process.

The Select Documents plugin extracts many fields from the JSON API and presents them to the Kettle output. The large number of fields allow Kettle processing to perform selections on the intermediate output before it is sent to the Execute Documents plugin. This lets the user refine the selection inside the Kettle tool.

There are three ways of running the scripts:

1. With a user interface, using a Kettle application called 'Spoon'. Spoon also allows you to edit and debug the scripts.
2. From a command line, using a Kettle application called 'Pan'.
3. From another Kettle script using the 'Job' step.

• Steps
  • AMQP Kettle Step Plugin
  • Execute Documents Plugin
  • JSON Decoder Plugin
  • OData Plugin
  • Raise Event plugin
  • Select Documents Plugin
    • Using the Select Documents Plugin
    • Configuring the Select Documents Plugin
    • Starting the Select Documents Transformation Using Spoon
  • Sentiment Score Plugin
  • Twitter Plugin